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Mode of Delivery: A Classroom Assessment 
Technique Comparison Between Verbal and 
Non-Verbal Communication 
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This study explores how using Classroom Assessment Techniques (CATs) in phone conversations with students may help to 
clarify learning objectives and encourage active learning in distance education. For this study, research was collectedfrom 
introductory undergraduate online courses at a university in the Southwest. Data was collectedfrom three classes where the 
instructor delivered a CAT during a phone conversation and in three classes where the instructor delivered the CAT in the 
section discussion forums. Both CATs were delivered during the first week of class and used as a formative assessment tech¬ 
nique to increase the student’s comprehension of the formatting required in the weekly summative assignment. The results of 
this study showed that the students who received the CAT verbally had a slight increase in demonstrating correct formatting 
on the assignment; however, both modes of delivery lead to an increase in the student’s understanding of this element. Further 
studies regarding the use of phone conversation to assess student learning is suggested. 


Research has shown there is a perceived lack of 
quality in regards to assessment feedback in higher 
education (Ferguson, 2011). A problem with Class¬ 
room Assessment Techniques (CATs; Angelo & 
Cross, 1993) in online higher education platforms 
today is that students do not perceive instructor 
feedback as helpful. This can result in the learners 
becoming disinterested thereby reducing the value 
of a learning opportunity (Ferguson, 2011). By en¬ 
gaging learners across multiple mediums, instruc¬ 
tors are able to directly assess student engagement 
and understanding. Examples of direct contact and 
engagement include telephone, email, and online 
instructional platforms designed specifically to sim¬ 
ulate the traditional classroom. Blackboard, Angel, 
and LoudCloud represent a few examples of these 
learning platforms that connect instructors and 
learners in real time. Actively engaging students 
in phone conversation is one way to change learner 
perceptions of the value of the instructor feedback 
and enhance the higher education experience for 
non-traditional students. This paper will discuss the 


effectiveness of a Classroom Assessment Technique 
when delivered verbally (telephone) versus non-ver- 
bally (electronic communication, e.g. email, online 
forum) as a strategy in an introductory undergradu¬ 
ate online course. 

BACKGROUND 

The literature review contained herein address¬ 
es the following considerations within a discussion 
of CATs in an online learning environment: student 
engagement, instructor-learner communication 
methods, and assessment techniques. These three 
areas are examined for their prevalence in educa¬ 
tion literature over the past twenty years (Angelo 
& Cross, 1993; Fluckiger, Vigil, Pasco, & Daniel¬ 
son, 2010; Moore & Kearsley, 1996; Vonderwell & 
Boboc, 2013). 

Classroom Assessment Techniques help faculty 
determine which students are and in some cases, are 
not, learning (Angelo & Cross, 1993). These assess¬ 
ment techniques help monitor which learning ob¬ 
jectives need to be focused on to make the learning 
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experience more specific and effective (Angelo & 
Cross, 1993). CATs are considered a formative as¬ 
sessment technique, as these exercises are often not 
graded but instead used to both foster student en¬ 
gagement and assess comprehension (Vonderwell 
& Boboc, 2013). CATs are a proactive approach 
to the teaching and learning process (Vonderwell 
& Boboc, 2013). Effectively using CATs in online 
education can be challenging due to the transac¬ 
tional distance between instructor and student. 
Face-to-face exchanges in a traditional classroom 
setting provide the opportunity for both instructor 
and learner to employ a broader range of strategies 
to fully acknowledge and engage various learning 
styles contained within student-teacher cognitive 
profiles. The physical distance in online learning 
may cause a communication gap and require an in¬ 
crease in innovative teaching techniques and learn¬ 
er behavior (Moore & Kearsley, 1996). 

Using CATs in the online learning platform can 
help close the communication gap (Vonderwell, 
2004). There are multiple ways to deliver a CAT in 
the online platform, as technology integration has 
become increasingly popular in online education. 
Communicating via email, instant messenger, vid¬ 
eo camera, or chat room are a few available web- 
based options. However, in introductory courses, 
instructors must be mindful of the learner’s tech¬ 
nological capabilities, as it can create a divide be¬ 
tween those students with access to technological 
tools and those without access. Instructors should 
assess student learning at multiple points within 
the instructional process for which alternative 
modes may be more appropriate depending on the 
technological skills of the student (Vonderwell & 
Boboc, 2013). 

In distance education, phone calls are an effec¬ 
tive introductory entry point mode of delivery for 
a CAT. Phone conversations allow the instructor 
to assess the student’s understanding of the ma¬ 
terial and address specific areas for improvement 
immediately. In addition, the instructor can gauge 
the student’s learning style and technological pref¬ 
erences for mode of delivery for later use in the 
instructional process. During this initial conversa¬ 
tion, the instructor has the ability to tailor the as¬ 
sessment technique to the student’s unique needs 
and goals. Feedback tailored to each specific stu¬ 
dent leads to a more personal experience for the 
online learner. 


Personalized assessment encourages active 
learning and combats challenges due to transaction¬ 
al distance. Interpersonal outreach strategies can 
open communication and create a learner-centered 
environment (Vonderwell, 2004). Effectively deliv¬ 
ering a CAT is an active feedback technique that in¬ 
vites students to be partners in the learning experi¬ 
ence. Studies have shown that involving students as 
partners in the assessment process enhanced higher 
order learning and increased student success. This 
is because providing frequent and meaningful as¬ 
sessment helps the student understand not only the 
need for improvement but also the reasons behind 
making the suggested changes (Fluckiger, et al., 
2010). This leads to a more positive personalized 
experience in the online classroom, which can lead 
to higher student success and retention. 

Further, research has supported the notion that 
positive communication from instructors leads to 
positive learning outcomes (Bailie, 2012). Person¬ 
alized feedback has also been proven to be an ef¬ 
fective technique to increase student motivation 
(Jarzebowski, Palermo, & Van de Berg, 2012). 
Motivation promotes personal accountability and 
encourages self-assessment in the learning pro¬ 
cess. To increase student motivation, it is effective 
to frame instructor feedback to the individual’s 
unique needs through regulatory focused feedback 
(Jarzebowski et al., 2012). Regulatory focus is when 
an individual uses preferred strategies to achieve a 
goal (Higgins, 2005). This type of feedback is per¬ 
sonal because it is specifically tailored to an indi¬ 
vidual’s distinctive goals and requests. The person 
receiving the feedback has individual preferences 
and this should be considered when the feedback 
is being formulated and delivered (Higgins, 2005). 
Delivering a CAT over the phone allows the stu¬ 
dent to experience the regulatory fit feedback im¬ 
mediately. 

While the purpose of delivering the CAT over 
the phone is to improve the student’s learning ex¬ 
perience and increase the student’s success on fu¬ 
ture summative assignments, phone calls also al¬ 
low the instructor to build rapport with the student 
as well as demonstrate verbal immediacy. Building 
a caring rapport and reinforcing personal mastery 
is important to online learners (Bailie, 2012). Ver¬ 
bal immediacy promotes effective learning, moti¬ 
vation, and cognitive development (Gorham, 1988). 
Immediacy refers to the degree to which an instruc- 
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tor can convey feelings in the student such as like 
or dislike or develop affective feelings (Mehrabian, 
1971). Conveying these feelings is especially im¬ 
portant in online education where the student does 
not have the ability to ascertain non-verbal cues 
that are apparent in traditional classroom settings. 

Moreover, due to the transactional distance, 
effectively evaluating student performance is espe¬ 
cially important (Vonderwell, 2004). Student per¬ 
formance can initially be influenced by learning 
style. Discovering the learning styles of students 
provides the instructor with information about the 
differences in learning preferences, which further 
guides the instructor in designing instructional 
strategies to support the different learning pref¬ 
erences (Saeed, Yun, & Sinnappan, 2009). These 
learning preferences can be established during a 
phone conversation. Once the initial conversation 
is held and learning preferences are established, the 
instructor can appropriately deliver the objectives 
of the curriculum per the student’s specific learn¬ 
ing style. Matching learning styles with technology 
preferences has shown to have a positive impact on 
academic performance (Saeed et al., 2009). 

Overall, using phone calls to assess student 
learning can be an effective formative assessment 
technique in the online post-secondary setting be¬ 
cause the instructor can assess the student’s tech¬ 
nological proficiency and their learning style, while 
providing immediacy and regulatory fit feedback. 

METHODS 

Due to the correlational nature of this study and 
the need to determine whether verbal delivery as 
opposed to non-verbal delivery of the CAT was sig¬ 
nificant, a between-group comparison was imple¬ 
mented. To determine the degree of impact, the in¬ 
dependent variable was changed and manipulated 
from delivering the CAT manually in the discus¬ 
sion forum to delivering the CAT verbally over the 
telephone. The idea is that changes in the depen¬ 
dent variable after manipulating the independent 
variable are due to or caused by the manipulation 
(Creswell, 2008). Manipulating the independent 
variable should have an effect on the dependent 
variable, which is the correct usage of the univer¬ 
sity’s required format for a week one assignment. 
This style is a version of APA formatting that all 
students in 100 and 200 level classes must use at 
the university. 


PARTICIPANTS AND PROCEDURE 

The participants for this study were selected 
from six sections in two introductory level bach¬ 
elor’s courses, both offered in the online platform. 
There were 127 participants in this sample. These 
classes represent the first course that every new 
student must take before moving forward with his 
or her program. The courses introduce students to 
the online learning environment and classroom re¬ 
quirements and are primarily taught by online full¬ 
time faculty members. 

Next, each instructor was asked to use the same 
assessment technique in week one regarding the 
use of the university’s required formatting style. 
The CAT used advised students that his or her first 
journal required the use of a particular style format 
and then assessed the student’s understanding of the 
formatting style and the importance of following 
the specific guidelines. Three instructors delivered 
the CAT vocally during his or her welcome phone 
call. These calls were recorded and documented 
by the instructor. In addition, the calls adhered to 
the guidelines set forth by the Family Educational 
Rights and Privacy Act (FERPA). The other three 
instructors delivered the CAT manually by post¬ 
ing it in the weekly discussion forum inside the 
online classroom and were asked not to discuss the 
requirement during their welcome phone call. The 
faculty members delivering the CAT verbally were 
instructed to use the same verbiage used in the CAT 
delivered in the weekly DQ forum. After the assess¬ 
ment technique was delivered verbally or manually, 
each of the six instructors recorded how many of the 
students used the required style format in his or her 
week one assignment, which the CAT discussed. 

Lastly, the researchers recorded the number of 
students in each of the six classes, the number of 
students that responded to the CAT, the number of 
students that submitted the week one assignment, 
and the number of students that successfully com¬ 
pleted the assignment using the correct format, 
which was given in the classroom assessment tech¬ 
nique either verbally or manually. It was hypoth¬ 
esized that the classes and students that received 
the CAT verbally would have a higher rate of style 
formatting use on the week one assignment. 

RESULTS 

The results of this study were divided into two 
categories: those who received the CAT verbally 
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and those who received the CAT non-verbally. The 
results of the two categories were then compared 
to determine whether an increase in the use of re¬ 
quired style formatting was accomplished by using 
voice delivery. 

Class one consisted of 20 online students in 
which 12 were reached by phone and received the 
CAT verbally. Of the 20 students, 17 completed the 
week one assignment and 10 students successful¬ 
ly used the required style formatting. This yields 
a 58.8% usage of the required style formatting, 
which excludes the missing data. 

Class two consisted of 20 online students in 
which all 20 were reached by phone and received 
the CAT verbally. Of the 20 students, 19 complet¬ 
ed the week one assignment and 18 students suc¬ 
cessfully used the required style formatting. This 
yields a 94.7% usage of the required style format¬ 
ting, which excludes the missing data. 

Class three consisted of 22 online students in 
which 17 were reached by phone and received the 
CAT verbally. Of the 22 students, 21 completed the 
week one assignment and 19 students successful¬ 
ly used the required style formatting. This yields 
a 90.5% usage of the required style formatting, 
which excludes the missing data. 

Class four consisted of 24 online students, 
which received the CAT manually in the online 
discussion forum of which three students acknowl¬ 
edged by replying to the CAT in the discussion fo¬ 
rum. Of the 24 students, 18 completed the week 
one assignment and 12 students successfully used 
the required style formatting. This yields a 66.7% 
usage of the required style formatting, which ex¬ 
cludes the missing data. 

Class five consisted of 22 online students, 
which received the CAT manually in the online 
discussion forum of which six students acknowl¬ 
edged by replying to the CAT in the discussion fo¬ 
rum. Of the 22 students, all 22 completed the week 
one assignment and 19 students successfully used 
the required style formatting. This yields an 86.4% 
usage of the required style formatting, which ex¬ 
cludes the missing data. 

Class six consisted of 19 online students, which 
received the CAT manually in the online discussion 
forum of which seven students acknowledged by re¬ 
plying to the CAT in the discussion forum. Of the 


19 students, 14 completed the week one assignment 
and 10 students successfully used the required style 
formatting. This yields a 71.4% usage of the required 
style formatting, which excludes the missing data. 

Classes one through three were combined in 
Figure 1 to make up the verbal CAT category, and 
classes four through six were combined to make up 
the non-verbal CAT category. 

Figure 1: Classroom comparison 

Classroom Comparison ■ Verbal CAT 

■ Non-Verbal CAT 
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Overall, the three classes that delivered the 
CAT verbally had an 82.5% success rate whereas 
the three classes that delivered the CAT manually 
in the classroom had a 75.9% success rate using the 
required style template on the week one assign¬ 
ment as shown in Figure 2. 

Figure 2: CAT effectiveness comparison 
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DISCUSSION 

The results of this study show that while there 
was a slight increase in effectiveness, there was not 
a significant improvement when the CAT was de¬ 
livered verbally over the phone as opposed to non¬ 
verbally by posting in the discussion forum. While 
these findings may not yield significant results, 
they do however show that the implementation of 
a CAT yielded a high percentage of comprehen¬ 
sion of the formatting requirements for the week 
one assignment. This aligns with previous studies 
that prove CATs are an effective method for student 
comprehension (Angelo & Cross, 1993; Lei, 2008; 
Vonderwell & Bobac, 2013). 

Additionally, as seen in Figure 1, the number 
of students that responded to the non-verbal CAT 
was significantly lower than those who responded 
verbally. It is important to note that students in the 
classes that received the CAT non-verbally within 
the discussion forum had access to view all posts 
within the forum without directly responding to it. 
Therefore, the number of students that responded 
to the CAT in the forum does not fully illustrate 
actual usage of the required style formatting for the 
week one assignment. 

Based on the data presented, it appears that both 
modes of delivery produced a high percentage of 
students that were able to demonstrate the elements 
assessed in their weekly assignment. Verbal com¬ 
munication provides an alternative platform for the 
instructor to assess the student’s comprehension 
of the material, even though the data in this study 
yielded similar results for both modes of communi¬ 
cation. The use of a CAT alone, regardless of mode 
of delivery, is an effective teaching strategy. 

LIMITATIONS AND FUTURE RESEARCH 

Even though the contributions of this research 
study are apparent, it is not without limitations. 
First, the data was collected from a small sample 
of students (N = 127). This makes it difficult to 
determine statistical significance in order to de¬ 
termine or assume a causal relationship. Further 
research would be beneficial with a larger sample 
of students in order to exemplify the population of 
students, which they are intended to represent. 

Second, the data was not compared to a con¬ 
trol group who did not receive a CAT. Since the 


requirement to use the required style formatting is 
outlined in the week one assignment directions, a 
control group would have provided useful infor¬ 
mation in regards to whether verbal or automated 
delivery is even necessary. The research findings 
would be stronger if they still hold after being com¬ 
pared to a control group. 

Third, variables that could limit the generaliz- 
ability of the results were not taken into consider¬ 
ation such as gender, age, incoming GPA, transfer 
credits, second language learners, and, most impor¬ 
tantly, technology proficiency considering the fact 
that the successful usage of required style formatting 
depends on working knowledge of Microsoft Word. 
In addition, it would be interesting to also take into 
account each student’s preferred learning and intel¬ 
ligence style, as this will affect the learner’s compre¬ 
hension based on mode of delivery. For example, an 
auditory learner would benefit more from a verbally 
delivered CAT as opposed to the written CAT. 

After extensive review, little research was un¬ 
covered on vocal communication in the online 
platform, but it has been shown that extra commu¬ 
nication efforts from the teacher can reduce the stu¬ 
dent’s concerns about course information, assign¬ 
ments, and objectives (Berge, 2013). Affirmative 
communication, whether it is delivered verbally or 
non-verbally, has an impact on student outcomes in 
both traditional and non-traditional settings (Bailie, 
2012). Bailie (2012) outlined four behaviors to cre¬ 
ate an online environment that increases learning, 
including initiating and maintaining contact, ad¬ 
justing communication to different learning styles, 
promoting personalization, and creating presence 
through communication. Delivering a CAT vocally 
aligns with these behaviors by increasing active 
learning in the online environment. 

Further research in the area of verbal commu¬ 
nication in the online platform can have signifi¬ 
cant implications for the online teacher and online 
learner in regards to maximizing student learning. 
Global technology calls for an increase in teaching 
techniques to meet its ever-changing needs. The de¬ 
livery of assessment techniques in the online plat¬ 
form is one of the many techniques worth exploring. 


GRAND CANYON UNIVERSITY 



Journal of Instructional Research | Volume 3 (2014) 


26 


References 

Angelo, T. A., & Cross, K. P. (1993). Classroom assessment 
techniques: A handbook for college teachers. San Francisco: 
Jossey-Bass. 

Bailie, J. L. (2012). The criticality of verbal immediacy in online 
instruction: A modified delphi study. Journal of Educators 
Online, 9(2), 1-22. 

Berge, Z. L. (2013). Barriers to communication in distance educa¬ 
tion. Turkish Online Journal of Distance Education, 14( 1), 
374-38 8. 

Creswell, J. (2008). Educational research: Planning, conducting, 
and evaluating quantitative and qualitative research. New 
Jersey: Pearson. 

Ferguson, P. (2011). Student perceptions of quality feedback in 
teacher education. Assessment & Evaluation in Higher Edu¬ 
cation, 36(1), 51-62. doi:10.1080/02602930903197883 

Fluckiger, J., Vigil, Y., Pasco, R., & Danielson, K. (2010). Formative 
feedback: Involving students as partners in assessment to 
enhance learning. College Teaching, 58(4), 136-140. doi:10.1 
080/87567555.2010.484031 

Gorham, J. (1988). The relationship between verbal immediacy 
and student learning. Communication Education, 37(1), 40- 
53. doi:10.1080/03634528809378702 

Higgins, E. T., (2005). Value from regulatory fit. Current Directions 
in Psychological Science, 14(A), 209-213. doi:10.1111/j.0963- 
7214.2005.00366.x 

Jarzebowski, A., Palermo, J., & van de Berg, R. (2012). When 
feedback is not enough: The impact of regulatory fit on 
motivation after positive feedback. International Coaching 
Psychology Review, 7(1), 14-32. 

Lei, S. A. (2008). Assessment techniques of instructors in two 
community colleges in a state-wide system. Education, 

128(3), 392-411. 

Mehrabian, A. (1971). Silent messages: Implicit communication of 
emotions and attitudes. Belmont, CA: Wadsworth. 

Moore, M. G, & Kearsley, G. (1996). Distance education: A sys¬ 
tems view. Belmont, CA: Wadsworth Publishing Company. 


Saeed, N., Yun, Y., & Sinnappan, S. (2009). Emerging web 
technologies in higher education: A case of incorporating 
blogs, podcasts and social bookmarks in a web programming 
course based on students’ learning styles and technology 
preferences. Journal of Educational Technology & Society, 
12(4), 98-109. 

Velez, J. J., & Cano, J. (2012). Instructor verbal and nonverbal 
immediacy and the relationship with student self-efficacy 
and task value motivation. Journal of Agricultural Education, 
53(2), 87-98. 

Vonderwell, S. (2004). Assessing online learning and teaching: 
Adapting the minute paper. Techtrends: Linking Research & 
Practice to Improve Leaning, 48(4), 29-31. 

Vonderwell, S., & Boboc, M. (2013). Promoting formative assess¬ 
ment in online teaching and learning. Techtrends: Linking 
Research & Practice to Improve Learning, 57(4), 22-27. 
doi:10.1007/s11528-013-0673-x 

Author Biographies 

Andrea received her Bachelor degree in Mass 
Communications with a concentration in Media 
Studies from The State University of New York 
at Oneonta (SUNY Oneonta) in 2005. In 2010 she 
earned a Master of Science in Leadership from 
Grand Canyon University (GCU) and in 2013 she 
earned a second Master of Science from GCU in 
Psychology with an emphasis in Industrial/Orga¬ 
nizational Psychology. Andrea celebrated her five 
year anniversary with Grand Canyon University 
this past March. She currently works as a Full-Time 
Online Faculty member and teaches University 
Success and Psychology courses. 

Jolene received her Bachelor of Arts in Art His¬ 
tory from The University of Wisconsin Madison 
in 2007. In 2011 she earned a Master of Science 
in Leadership from Grand Canyon University and 
is currently working on her Ph.D. in Psychology 
with an Emphasis in Cognition and Instruction and 
expects to finish in the spring of 2015. Jolene has 
worked in higher education since 2008 in various 
positions, the most recent being a Full-Time Online 
Faculty member at Grand Canyon University for 
the past two years. 


GRAND CANYON UNIVERSITY 



